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■  Ih  this  paper  we  propose'  different  methods  for  finding  the  global 
minimum  of  a  concave  function  subject  to  quadratic  separable  constraints.  The 
first  method  is  of  the  branch  and  bound  type,  and  is  based  on  rectangular  parti¬ 
tions  to  obtain  upper  and  lower  bounds.  Convergence  of  the  proposed  algo¬ 
rithm  is  also  proved.  For  computational  purposes,  different  procedures  that 
accelerate  the  convergence  of  the  proposed  algorithm  are  analysed. 

The  second  method  is  based  on  piecewise  linear  approximations  of  the 
constraint  functions.  When  the  constraints  are  convex  the  problem  is  reduced 
to  global  concave  minimization  subject  to  linear  constraints.  In  the  case  of  non- 
convex  constraints  we  use  zero-one  integer  variables  to  linearize  the  con¬ 
straints.  The  number  of  integer  variables  depends  only  on  the  concave  parts  of 
the  constraint  functions.  1  *  !  ’  ■ 


*  Parts  of  the  present  paper  were  prepared  while  the  second  author  was  visiting  Georgia  Tech  and  Penn  Stale  Universi¬ 
ty- 
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Introduction 

In  this  paper,  we  are  concerned  with  determining  the  global  minimum  of  problems  of  the 

form: 

global  min  /( x) 

s.t.  gi(x):=  £  (-^PikXk+qucXk+ruc)  $  0,  i=l - m  (1) 

m  ^  xk  <  mk,  k= 1 . n 

where  pA,  q ■&,  r ik,  m*.,  mk,  (i =1 . m  and  k= 1,  ...  ,n)  are  given  real  numbers,  f  (x)  is  a 

real  valued  concave  function  defined  on  an  open  convex  set  containing  the  rectangle 
M(f={x:m  £  x  £  m },  •  •  •  .EU)r.  .  .  .  ,m„)T .  Denote  by  D  the  feasible  set 

of  problem  (1).  Clearly,  D  is  compact  and  /  is  continuous  on  D  so  that  the  global  minimum 
of  /  over  D  exists. 

Note  that  the  second  problem  addressed  in  the  title  of  the  paper  can  be  included  under 
problem  (1),  since 

n  -I 

global  min/oCr)  =  £  (-Po*x*2-K7o* **+'(*) 

*=i  ^ 

s.t.  xbD 

is  equivalent  to 

global  min  t 
s.t.  xeD,f0(x)  £  t 

with  the  additional  variable  teR. 

Problems  of  the  form  (1)  are  very  difficult  to  solve.  Sahni  [21],  proved  that  the  problem 
(with  a  linear  objective  function  and  quadratic  constraints)  is  NP-hard.  Interest  in  this  problem 
is  apparent  from  its  practical  applications  as  well  as  from  the  theoretical  point  of  view.  Many 
practical  problems  that  can  be  formulated  as  in  (1),  include  location  problems,  production  plan¬ 
ning,  and  minimization  of  chance-constrained  risks  [18].  Recently,  it  has  been  shown  that  some 
VLSI  chip  design  problems  lead  to  the  formulation  of  quadratic  programs  with  quadratic  con¬ 
straints  [11]. 

In  this  paper,  we  propose  different  methods  for  the  solution  of  (1).  From  the  computa¬ 
tional  point  of  view  we  are  interested  in  algorithms  that  determine  an  e-approximate  solution. 
First  we  develop  a  branch  and  bound  algorithm  which  is  based  on  rectangular  partitions  to 
obtain  upper  and  lower  bounds  on  the  global  minimum.  Next,  we  use  piecewise  linear  approx¬ 
imations  of  the  constraint  functions.  When  all  g,(x)  are  convex  we  reduce  the  approximate 


piecewise  linear  program  to  concave  minimization  subject  to  convex  constraints.  For  noncon- 
vex  constraints  we  use  zero-one  integer  variables  to  linearize  the  piecewise  linear  functions  that 
approximate  the  concave  parts  of  the  constraint  functions. 

There  is  little  work  done  on  nonconvex  problems  with  quadratic  constraints.  In  [4],  a 
dual  method  is  developed  for  minimizing  a  convex  quadratic  function  subject  to  convex  qua¬ 
dratic  constraints.  This  method  may  be  used  to  obtain  approximate  solutions  of  (1),  when  a 
convex  approximation  of  the  objective  function  can  be  computed.  Problems  with  a  linear 
objective  function  and  quadratic  constraints  have  been  considered  by  Kabe  [10].  Reeves  [20] 
proposed  a  branch  and  bound  type  algorithm  for  (1),  where  the  objective  function  is  separable. 
This  algorithm  is  based  on  locating  local  minima  using  linear  programming  techniques  (see 
also  [12]).  Other  methods  for  related  problems  are  given  in  [2],  [3],  [6],  [13],  [22]  and  [23]. 

Branch  and  bound  algorithm 

The  algorithm  proposed  for  solving  problem  (1)  will  be  a  Branch-and  Bound  (BB)  pro¬ 
cedure  consisting  of 

more  and  more  refined  rectangular  partitions  of  the  initial  rectangle  Af0, 

lower  bounds  p(M)<min/(M)  associated  with  each  partition  element  (rectangle)  M 

generated  by  the  procedure, 

upper  bounds  a,  >  min/  (D )  determined  in  each  step  r  of  the  algorithm, 

certain  deletion  rules  by  which  some  partition  sets  M  are  deleted  since  we  know  that 

MnD=0  or  that  min/(D)  cannot  be  attained  in  M. 

We  briefly  discuss  the  four  elements  of  the  procedure  before  presenting  a  complete  state¬ 
ment  of  the  algorithm. 

Subdivision  of  rectangles 

Definion  1:  Let  MczRn  be  an  n -dimensional  rectangle  (n -rectangle)  and  let  /  be  a  finite 
set  of  indices.  A  set  [Af(:/e/ }  of  n  -rectangles  Af-cAf  is  said  to  be  a  rectangular  partition  of 
M  if  we  have 

M  -  ij  Mt ,  MtnMj=dMtrx)Mj  for  all  i,jel,i*j,  (2) 

where  dM,  denotes  the  boundary  of  A/,  . 

Definition  2:  Let  [Mq }  be  an  infinite  decreasing  (nested)  sequence  of  rectangular  parti¬ 
tion  sets  generated  by  the  algorithm.  The  underlying  subdivision  procedure  of  rectangles  is 
called  exhaustive  if  the  sequence  of  diameters  d(Mq)  of  Mq  satisfies 


Note  that  an  n -rectangle  M={x:a  Zx  Zb),  a,beRn,  a<b,  is  uniquely  determined  by  its 
"lower  left”  vertex  a ,  and  its  "upper  right”  vertex  b .  Each  of  the  2*  vertices  of  M  is  of  the 
form 

a  + 1 

where  /  is  a  vector  with  components  0  or  (6,— a,)  (t=l . n),  and  for  the  diameter  d(M)  of 

M  we  have 

d(M)  =  116-dll, 

where  II .  II  denotes  the  Euclidean  norm  in  /?*. 

A  very  simple  frequently  used  subdivision,  called  bisection  (e.g.  Horst  [8]),  consists  of 
subdividing  an  n -rectangle  M={x\a  Zx  Zb)  into  two  n -rectangles  by  a  cutting  hyperplane 
through  (a+b)l2,  perpendicular  to  the  longest  edge  of  M.  It  is  well  known  that  bisection  is 
exhaustive  in  the  sense  of  Definition  2. 

Lower  and  upper  bounds 

Let  M  be  an  n  -rectangle  and  denote  by  V(M)  the  vertex  set  of  M.  Then  it  is  well 
known  that,  by  concavity  of  /,  we  have  min/  {M )  =  min/  (V  {M ))  and  for  the  lower  bound 
(3(A/)  we  set 

3(Af )  =  min  /  ( V  (M  )).  (4) 

Obviously,  we  have 

p(Af)  <  min  /  (D  rM ) 

whenever  D  rM  *0. 

For  the  upper  bounds  a,  >  min/(D )  in  step  r  of  the  algorithm,  we  always  choose 

ar=min/(Sr),  (5) 

where  Sr  is  the  set  of  feasible  points  calculated  until  step  r,  that  is,  we  have 

Or  =  fix'),  (6) 

where  xr  is  the  best  feasible  point  determined  so  far.  If  feasible  points  are  not  available,  i.e. 


Deletion 


A  partition  set  M  is  deleted  of  course  whenever  we  have  (3(Af  )>as  for  some  iteration 
step  s ,  because  then,  clearly,  the  global  minimum  of  D  cannot  be  attained  in  M . 

A  more  difficult  question  is  that  of  properly  deleting  infeasible  partition  sets  M ,  i.e.,  sets 
satisfying  MnD=0.  Usually  M  is  known  by  its  vertex  set  V(M)  and  V  (M  )nD  =0  does  not 
imply  MnD=0.  Therefore,  from  the  information  at  hand,  we  will  not  be  able  to  delete  all  par¬ 
tition  sets  M  satisfying  MnD=0,  and  we  have  to  apply  a  "deletion  by  infeasibilty"  rule  that  is 
"certain  in  the  limit"  in  the  sense  of  fathoming  "enough"  infeasible  sets  to  guarantee  conver¬ 
gence  of  the  algorithm  to  a  global  minimum  of  /  on  D. 

In  order  to  derive  such  a  deleting  rule,  note  that  each  constraint  function  &  is  obviously 
Lipschitzian  on  M ,  that  is,  there  is  a  constant  L,  =L,  (Af  )>0  such  that  we  have 

lg,(z)  -  g,-(je)l  ^  Li  llz  -  x  II,  for  all  x,  zeM.  (7) 

An  upper  bound  for  L,-  is  given  by  any  number  A,  satisfying 

Ai  ^  max{  II  Vgi(y)li  :ysM }.  (8) 

Let  M  =  {jc:  ak  <,  xk  £  bk,  k- 1,  .  .  .  ,n }.  Using  monotonicity  and  separability,  we  see  that 

Ai  =A,*  =  max  {IIVg,(y)ll:yeAf }  (9) 

is  given  by 

V  =(Z(  max  I p*yk  +  q*  l)2]1/2  =  [  Z  (P.*a*  +  ?i*)2  +  Z  (P*6*  +  ?,*)2]1/2  (10) 

where 

Ntl  =  (*:-  —  >  °k  +  bk  },  Ni2=  [k:-  — 

Pa  2  Pi*  2 

Let  V'(M)  be  any  nonempty  subset  of  the  vertex  set  V(M)\  for  example  V (M)={a  ,b }  if 
M=[x:a  <  x  S  b }.  Denote  again  by  d(M)=\\a-b  II  the  diameter  of  M .  Then  we  propose  the 
following: 

Deletion  Rule  (DR):  Delete  a  partition  set  M  whenever  there  is  an  i  e  { 1 . m  }  satis¬ 

fying 

max  {gi(x):xeV(M)}  -A,d(M)>  0  (11) 

where  /!,•>£,  (see  (8),  (9)  and  (10)). 

Lemma  1:  Let  the  subdivision  procedure  be  exhaustive  and  apply  the  Deletion  Rule 
(DR).  Then  every  infinite  decreasing  sequence  [Mq }  of  partition  sets  generated  by  the 


algorithm  satisfies 


M.  -»  {a:},  xeD. 


Proof:  The  definition  of  an  exhaustive  subdivision  implies  that  there  is  a  point  x  satisfy¬ 


ing  Mq  — »  {x }.  We  have  to  show  that  xeD.  Let  A, (M. )  be  an  overestimator  of  the 


Lipschitzian  L,  (Mq )  of  gi  on  Mq.  Since  [Mq }  is  a  decreasing  sequence,  we  may  assume  that 
Al(Mq+l)  <  A,(Mq)  holds  and  that 


A  >Ai(Mq),  for  all  q,  <= 1,  .  .  .  ,m 


is  at  hand. 


Apply  deletion  rule  (DR)  and  suppose  that  we  have  x4D .  Since  Mq-*{x},  by  continuity 
of  g,  ({=1,  .  .  .  ,m)  and  by  (12),  it  follows  that,  for  each  sequence  of  nonempty  sets 
V (Mq)aV(Mq),  we  have 


max  {g,(x):xeV'(M?)}  -  A,  (M,  )d  (A/? )  gi(x),  /= 1 _ ,m 


As  x4D ,  there  is  at  least  one  ie  {1,  .  .  .  ,m }  satisfying  g, <T)>0.  Taking  into  account  bounded¬ 
ness  of  {Ai(Mq)},  d (Mq )—>0  and  continuity  of  gi,  we  see  from  (13)  that  there  is  a  positive 
integer  q0  such  that 


max  {gi(xyjceV  (Mq))  -  Ai(Mq)d(Mq)  >0,  for  all  q>q0 


holds.  This  is  a  contradiction  to  the  deletion  rule  (DR). 


Remark:  Note  that,  by  A,  2=  L,,  we  have  g,(z)  >  g;  (*)-/.;  ilz-x  II  >  g,(x)-A,d(Af )  for 
all  x,zeM  and  (11)  implies  gt (z )  >  0  for  all  zeAf,  hence  deletion  rule  (DR)  does,  in  fact, 
only  fathom  infeasible  sets  M . 


The  algorithm 


Step  0. 


Let  Mq=M,  choose  SMq cD  (possibly  empty)  and  determine  p(M0)=min/(V(A/)), 
Oo=min/ (SM(>)  (Oo=»  if  5Mo=0).  Let  /o=( Af 0) .  and  Po=P(M0).  If  (Xo<°°  then  choose 
*°e argminf  (SMn)  (i.e.  /(x0)^).  If  o^-PcpO  (<e>0  for  practical  purposes)  then  stop; 
cxo=Po=min/(D)  (ao-po^e).  x°  is  an  e-approximate  solution.  Otherwise  set  r=l  and  go  to  step 


Step  r. 


At  the  the  begining  of  step  r  we  have  the  current  rectangular  partition  Ir_x  of  a  subset  of 
M0  still  under  consideration.  Furthermore,  for  every  Me/,.,  we  have  SMcMnD  and  bounds 


P(M),  a(M)  satisfying 


P(Af)  =  min / (M)  <  a (M ). 

Moreover,  we  have  the  current  lower  and  upper  bounds  Pr_j,  otr_1  satisfying 

pr_i  £  min /(D)  £  ov_j. 

Finally,  if  then  we  have  a  point  xr"’eD  satisfying  /(xr-1)=ar_1  (the  best  feasible 

point  obtained  so  far). 

r.l  Delete  all  Melr_{  satisfying  p(Af )>ar_!.  Let  Rr  be  the  collection  of  the  remaining  rec¬ 
tangles  in  the  partition  lr-\. 

r.2  Select  a  nonempty  collection  of  sets  PrcJRr  satisfying 

argmin  (p(Af):  A/e/r_1}c/>r  (14) 

and  subdivide  every  member  of  Pr  by  bisection  (or  any  other  exhaustive  subdivision 
yielding  rectangular  partitions).  Let  Pr '  be  the  collection  of  all  new  partition  elements. 

r.3  Fathom  any  MeP/  satisfying  deletion  rule  (DR).  Let  1/  be  the  collection  of  all  remain¬ 
ing  members  of  P/. 

r.4  Assign  to  each  Mel/  the  set  SMczMnD  of  feasible  points  in  M  known  so  far  and 
P(Af )  =  min  /  (V (M )),  a(M)  =  min/(SM)  «x(M)=~  if  SM=0). 

r.5  Set  Ir  =  (Rr  -  Pr  )u//.  Compute 
a,  =  inf  {a(Af ):  Melr), 
pr  =min{p(M):  Melr), 

If  otr<'».  then  let  x'eD  such  that  f  (xr  )=ar . 

r.6  If  ar-pr=0  (<e),  then  stop;  xris  an  e-approximate  solution.  Otherwise  go  to  step  r+1. 

The  convergence  of  the  algorithm  is  based  on  the  following  theorem. 

Theorem  1:  (i)  The  sequence  of  lower  bounds  pr  satisfies 

p  :=  lim  Pr  =  min  /  (D ). 

r  — *» 

(ii)  Assume  that  we  have  SM  *0  for  all  partition  sets  M .  Then 

P  =  lim  pr  =  min  /(D)  =  lim  =:  a 

r  — *oo  r  — 

holds  and  every  accumulation  point  of  the  sequence  { x' }  solves  problem  (1). 


Proof:  (i)  Using  a  standard  argument  on  finiteness  of  each  partition  /r  (e.g.  Horst  [8], 
Horst  and  Tuy  [9]),  we  see  by  the  selection  rule  (14)  that  there  must  be  a  decreasing  sequence 
{Mq  }  of  successively  refined  partition  sets  satisfying 

P(AV  =  IV  (15) 

Clearly,  by  construction,  {pr)  is  a  nondecreasing  sequence  bounded  from  above  by  min /(D) 
such  that 

P  :=  lim  pr  <  min  /(D)  (16) 

r— 

exists. 

From  Lemma  1  we  see  that  lim  Mq=[x)  and  xeD  hold.  But 

q  — *x> 

$(Mq  )=min/  (V  (Mq  ))=/  (v* )  where  vqeV(Mq)czMq,  hence  continuity  of  /  implies  that  we 
have 

lim  p(A i,)  =  f{x).  (17) 

q  — Foo 

Combining  (15),  (16),  (17)  yields 

P  =  /  CD  ^  min  /(D) 

which  is  only  possible  if  / (x )=min/  (D )  since  xe D . 

(ii)  Whenever  SM*0,  i.e.,  a(A/)<°°  for  all  partition  elements  M ,  then  the  algorithm  can 
be  regarded  as  a  realization  of  the  general  (BB)-  scheme  presented  in  Horst  [8]  or  in  Horst  and 
Tuy  [9]  and  (ii)  follows  from  the  theory  developed  in  these  papers  if  we  show  that  the  bound¬ 
ing  operation  is  "consistent",  i.e.,  if  a(M?  }-P(M?  )->0  as  q  for  every  decreasing  sequence 
{Mq}. 

We  have  already  seen  that  Mq  — >  (x),  xe  D ,  and  P(M?)  — >  fix)  hold.  But 

*  q  — *oo  q  — 

a(M,?>=min/(Sw?),  0^M?cAf?,  and  continuity  of  /  imply  that  likewise  we  have 
a(M?)  ->  fix). 

q  — 

Remark:  For  problem  (1)  it  may  be  difficult  to  obtain  enough  feasible  points  such  that 
Sw*0  for  all  partition  elements  M .  In  that  case,  we  propose  to  consider  the  iteration  sequence 
{ xr }  defined  by  /  (jcr  )=Pr .  Note  that  xr  is  not  necessarily  feasible  for  problem  (1).  However, 
it  can  be  proved  in  a  similar  way  as  above  that  every  accumulation  point  of  {xr )  solves  prob- 


Computational  considerations  and  acceleration  of  convergence 

The  general  algorithm  was  shown  to  converge  using  only  simple  calculations  to  make 
decisions  on  partitioning,  deleting  and  bounding.  A  closer  examination  presented  here  leads  to 
procedures  that  allow  improved  bounding,  at  the  expense  of  solving  additional  subproblems  to 
extract  the  information  needed  for  these  decisions. 

Let  us  assume  that  M  has  not  been  deleted  by  the  deletion  rule  (11).  We  may  still  have 
M  nD  -  0.  Currently,  the  algorithm  assigns  a  lower  bound  on  the  minimum  of  /  over  M  cD 
as 

p(A/ )  =  min  / (A/)  =  min  / </(MnD). 

Since,  from  Step  r.l,  M  is  deleted  whenever  $(M)  >0,.],  a  tighter  lower  bound  would 
invoke  this  test  sooner.  Assuming  MnD*Q,  a  mechanism  needs  to  be  devised  for  identifying 
points  in  S^cMnD.  Otherwise,  as  mentioned  earlier,  it  is  conceivable  for  SM=0  for  all 
Afe/r_j  (in  this  case,  ar_l  =  °°).  These  two  situations  shall  be  addressed  next.  In  particular, 
we  shall  attempt  to  obtain  a  better  bound  than  P(Af )  by  using  only  linear  programming  calcula¬ 
tions.  In  the  process,  we  will  be  able  to  identify,  at  times,  when  MnD  =  0  or  possibly  even 
uncover  feasible  points  of  MnD*@  for  inclusion  in  SM . 

We  begin  by  proposing  a  simple  linearization  of  the  constraints  in 

G  =  {x:  gi(x)  =  £  i.~;PlkXk2  +  qikxk  +  r*)  <  0,  i=l . m }. 

*=1  1 

1  7 

Note  that  MnD  =  MnG  since  M<zM0  and  D  -  MqOG  .  Let  &*(**)  =  ~p,kxk  +  qlkxk  +  rik 
and  let  VexAf  denote  the  convex  envelope  of  /  over  A .  Then  we  have  [5] 

VexMg, (x)  =  J/Vex^gik(xk)  <  g,(x)  (18) 

*=1 

where 

M*  =  S xk  <bk},k= 1 - n. 

Each  glk(xk)  is  linearized  by  one  of  the  following  three  cases: 

Case  1 :  plk  =  0.  Then  glk  ( xk )  is  linear 

Case  2:  pik  <  0.  Then  glk (xk )  is  concave  and  Vex^  gik(xk)  =  ctlkxk  +  pijk  where 
«,*  =  lg,k(bk)  -  glk(akW(bk  -  ak),  (3,*  =  glk(bk)  -  a lkbk  =  gtk{ak)  -  a lkak. 


Replace  glk(xk)  by  /,*(**)  =  alkxk  +  pa. 


Case  3:  plk  >0.  Then  glk  is  convex.  Compute  xk=-qiklplk  which  minimizes  gik.  If 
glJc(xk)>0,  replace  gik(xk)  by  the  constant  g^ (xk )  in  the  constraint  gt (x j<0.  (This  effectively 
enlarges  the  region  feasible  to  that  constraint).  Otherwise,  continue. 

Case  3a:  If  £k<ak,  compute 

Pi*  =  ~  [~Pik  +  (<hk2-2Pikrik)m]- 
Pik 

Replace  guc(xk)  by  the  linear  support  of  its  graph  at  pi.  This  is  given  by 


lik(Xk)  =  <*<***  +  ft*  <  gik(Xk), 


where  aik  =  Pi*pi  +  Pik  >  0  and  p*  =  -a*  pi. 

Case  3b:  If  £k  >  bk,  replace  g^  (xk )  by  the  linear  support  of  its  graph  at 

P^  =  —  H7 ik  ~  (Pik  ~  2 Pucrik)V\ 

Pik 

namely, 

4k(*t)  =  CLjtXit  +  pa  <  &*(**)• 

where  aik  =  Plk pi  +  q*  <  0  and  p*  =  -a^pi- 

Case  3c:  If  ak  <  £k  <,  bk,  compute  pi  and  pi,  as  above,  and  replace  glk (xk )  by  the  max¬ 
imum  of  the  supports  at  pi  and  pi. 


where 


max  {/iCc*),  llk(xk)} 


ItkM  =  aixk  +pi,  7  =  1,2 

®i  =  Pi* Pi  "*■  Pik’  j  ~  2 

Pi  =  -aipi.  j  =  1.  2. 


Let  t,  be  the  number  of  terms  in  £,(*)  that  fall  into  Case  3c.  That  is,  r,  is  the  cardinality  of 
the  index  set 


K,  =  [k  -  Pik  >  0,  glk(xk)  <0,ak<xk<bk,  *=1,  ,n  } 
Using  the  above  linearization,  for  each  constraint  i  we  have 

/.■(*)•-  Z  hk(xk)  +  Z  ma x  {l;l(xk),  l,l(xk))  <  gi(x), 

kdK,  keK; 


where  we  take  lik  (xk )  =  glk  (xk )  in  the  case  pik  >  0  and  gtk  (xk )  >  0.  Now,  we  have  /,  (x )  is  a 
linear  underestimate  of  g,(x)  when  =  0,  and  it  is  piecewise  linear  and  convex,  otherwise. 


In  particular,  the  region  defined  by  /,-(*)  <  0  is  equivalent  to  the  polyhedral  set 

Z  lik(.*k)  +  Z  z.a  ^  0 

kaK,  keKj 

ti(xk)  <■  Zik,  keKj 

l£(xk)  <,  z*,  keKi, 

which  involves  r,  new  variables  (zn . zu.)  and  2 r,  additional  constraints. 

Performing  the  above  linearization  for  every  constraint  i ,  let  L(G )  denote  the  resultant 
polyhedral  set  and  let  LX(G)  denote  its  projection  onto  the  n -dimensional  space  of  x.  It  is 
clear  that 

LX(G)  3  conv(G)  3  G 

where  conv(G)  denotes  the  convex  hull  of  G .  Also,  it  is  clear  that  if  (x,  z)  minimizes  / (x) 
over  L(G)nM,  then  x  minimizes  f(x)  over  Lx(G)nM,  If  Lx(G)nM  =0,  then 
GrM  =  MnD  =  0. 

Since  /  is  concave  (with  no  assumed  exploitable  structure),  too  much  effort  is  required  to 
find  the  global  minimizer  x.  Instead,  we  seek  an  ie£x(G )nM  that  satisfies  / (i)  <  f  (x). 
Consider  the  problem 

min  f{x)  (19) 

s.t.  (x,  z)eL(G)  n  M. 

Since  the  feasible  set  is  compact,  the  algorithm  of  Falk  and  Hoffman  [7]  applies.  But  we  only 
run  the  algorithm  until  the  best  lower  bound  occurs  at  a  point  (£,£)  that  satisfies 
£ eL,(G)rW.  Their  method  guarantees  that  /(£)  <  f  (X),  as  desired.  Thus,  we  obtain 

P(M)  =  min  f(M)  < /(£)  <  min/(Mn£>), 

thereby  achieving  a  higher  lower  bound  than  |3(Af ).  If  JceG ,  then  SM#0.  Otherwise,  schemes 
can  be  developed  to  find  at  least  one  point  in  Lx(G)nG ,  starting  from  i,  and  these  points  are 
added  to  the  set  SM . 

Bilinear  constraint  approach 

An  alternative  linearization  of  G  can  be  derived  from  the  bilinear  constraints  that  arise 
from  the  quadratic  constraints  in  the  following  way.  Each  constraint  function  can  be  written  as 

giO O  =  Z(tP«***2  +  <7  *xk  +  r,k)  =  £(x*y,*  +  rlk) 

**i  z  *=i 


I 


-  12  - 


where  yA  =  —plkxk  +  qik  for  every  i  and  all  k.  We  also  have  from  Theorems  2  and  3  of  Al- 


Khayyal  and  Falk  [1] 


n 


VexQigt(x)  =  ^[Vex^ix^j,)  +  r*] 

*=i 


(20) 


where 


£2,  =  £2,,xni2x 

=  {(Xk.yut)-  <*k  ^  xk  <,  bk,  c*  <.  y*  <,  (I*) 

Vexo^ixtyit)  =  max^x*,?*),  /j(x*.  y*)} 

ll&kVat)  ~  cik*k  + 
lik(xk,yik)  *  4***  +  bkyA-bkdlk 

cik  ~  -jminlPitfl*.  P;*6* }  +  Qik 
dik  =  -^max^a*,  +  <?,*. 

Let  y,  =  (ya,  .  .  .  .y^f .  Since  Vexn.g,(x)  is  piecewise  Unear  and  convex,  the  feasible  region 
defined  by 

Vexn,g,  (x)  <  0 

yik  =  \pikXk  +  qik.  *- 1 . « 


(x,  y,)e 

is  equivalent  to  the  polyhedral  region  involving  «  additional  variables  (zn . zin)  and  2n 

additional  linear  inequality  constraints: 


n 


E2*  ^  o 

*=i 


yik  =  -^PikXk  +  <7.*.  *=L  ■  •  .n 

l*(Xk,ytk)  +  rik  <  z,*,  *=1 - n 

ti(Xk,y>k )  +  rik<zik,k= 1 . n 

(x,  y,)e  £2,-. 

This  is  done  for  each  constraint  i=l,  ...  ,m  to  yield  a  polyhedral  set  P(G )  whose  projection 
onto  RH  (the  space  of  x -variables),  denoted  by  PX(G)  contains  the  convex  huU  of  G;  that  is, 
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we  have 

G  c  conv(G )  c  Pz(Q)- 

Hence, 

min  {/ (x):  (x ,  y ,  z )e P (G )nM  }  £  min  (/ (x):  xeG  nW } . 

The  discussion  at  the  end  of  the  preceding  section  may  now  be  followed  with  the  set  L(G ) 
replaced  by  P(G)  and  the  vector  (x ,  z )  replaced  by  (x  ,y  ,z ). 

Piecewise  linear  approximation 

In  [17],  [19],  a  computational  algorithm  is  proposed  for  the  solution  of  separable  concave 
problems  subject  to  linear  constraints.  In  that  paper  an  approximate  piecewise  linear  program  is 
considered  that  provides  an  e-approximate  solution  for  any  given  tolerance  e  >  0.  The  concave 
piecewise  linear  program  is  solved  by  using  an  equivalent  mixed  zero-one  integer  linear  pro¬ 
gramming  formulation  (see  also  [14])  having  a  simple  structure.  The  same  techniques  have 
been  extended  for  problems  with  an  indefinite  quadratic  objective  function  [15]. 

For  problem  (1)  we  assume  that  the  objective  function  /(x)  is  continuous.  For  each 
interval  [m*,m*]  choose  a  fixed  grid  of  points  by  partitioning  it  into  nk  subintervals  of  length 

hk  =  (mk-nu)/nk.  (21) 

n  n 

Let  Y,'  (x )  —  ^ *tik  (^ik )  ^  the  piecewise  linear  function  thut  approximates  8i(x)  =  £&*(**)• 

*= i  *=i 

Each  piecewise  linear  function  yik(xk)  interpolates  g& (x* )  at  the  grid  points  xk]=mk+jhk  for 
j= 0 . nk.  We  may  assume  that  nk  >  1,  since  for  nk  =  1  we  obtain  a  linear  function  inter¬ 

polating  each  gjjt(xk)  at  the  endpoints  tth  and  mk.  Then  the  separable  piecewise  linear  pro¬ 
gram 

global  min  /(x) 

n 

s.t.  7 i(x)=  £y,*(x*)<0,  i=l . m  (22) 

*=i 

mk  <  xk  <mk,  k= 1, 

will  provide  an  approximate  solution  to  the  original  problem  (1).  The  approximation  error 
depends  on  the  mesh  sizes  hk,  k= 1,  .  .  .  ,n,  and  the  curvature  of  the  objective  and  constraint 
functions. 
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Piecewise  linear  interpolation  preserves  monotonicity  .convexity  and  concavity.  Next  wc 
prove  that  when  the  constraint  functions  g,(x)  are  convex  then  the  piecewise  linear  approxi¬ 
mate  problem  (22)  is  reduced  to  an  equivalent  one  with  linear  constraints. 


Convex  constraints 


If  g(x)  is  a  piecewise  linear  convex  function,  then  g(x)  can  be  defined  as  the  pointwise 
maximum  of  k  affine  functions  l\(x),  .  .  .  ,/*(x),  that  is 


Moreover,  given  the  set 


g(x)  =  max  {/j (x) . /*(x)}. 


S  =  (x:Xmax{V(x),  .  .  .  ,V(x)}  £  0} 
7=1 


we  associate  the  following  set  (with  n  additional  variables): 

S  =  {( x,y):yj  >  /^(x),  /'= 1 . k,j= 1 . n  and  X>>7  <  0}. 

7=1 

Then  it  is  easy  to  see  that  if  (x,y)  solves  the  problem  min{/ (x):  (x,y)eS },  then  x  solves 
min{/ (x):  xeS }. 

Let  l^(xk)  be  the  affine  function  that  coincides  with  (xk )  in  the  interval  [x*;_1  xj], 
where  xkJ=m*+jf i*.  j- 1,  •  -  -  ,n*.  Then  by  (23) 

Y.CO  =  XY*(*i*)  =  X  max  {/^(x*) - /»*(**)}.  i=l - m, 

*=t  *=i 


where 


hkJ  =  it* (V  Hfo ( V1  ))(** -au-O'-iy** )/hk  +y »(V).  ;'=1 . «*• 


Hence,  problem  (22)  can  be  solved  by  solving  the  following  problem  under  linear  constraints: 

global  min  /(x) 

n 

s.t.  X  Yi*  +r<*  ^  o,  i=l,  .  .  .  ,m  (24) 

*=i 

Yi*  ^  [ikJ(*k)’  k-l,  ...  ,n,  j=\,  ...  ,nk,  i=\,  ...  ,m 
nik  <  xk  <  mk,  k= 1 . n 

If  (x*  ,y* )  is  a  solution  of  problem  (24),  then  x*  solves  problem  (22).  The  number  of  addi¬ 
tional  variables  y&  introduced  is  independent  of  the  number  of  partitions  used  and  is  equal  to 

Y  =  mn. 

The  number  of  additional  constraints  depends  on  the  partition  set  and  is  given  by 

n 

C  =  mn  X  nk  ■ 

k= 1 
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When  f(x )  is  a  concave  quadratic  function  problem  (21)  is  a  global  concave  minimiza¬ 
tion  under  linear  constraints.  A  method  such  as  the  one  described  in  [17]  can  be  used  to  obtain 
a  guranteed  e-approximate  solution. 

If  the  objective  function  is  indefinite  quadratic,  we  have  the  same  approach  since 
indefinite  quadratic  programming  is  reduced  to  concave  programming  with  convex  constraints. 
This  is  true  because  if  / (x)  is  indefinite,  then  f(x)  =  / ,(x)  +  / 2(x)  where  f  \(x)  is  concave 
and  /  2(x)  is  convex.  Then  any  problem  of  the  form 

global  min/(;c)  =  /,(*) +  /2Ct) 

xeS 

is  equivalent  to  the  concave  minimization  problem 

global  min  /i(x) 


s.t.  xeS ,  f2(x)  <  y 


with  y  an  additional  real  variable. 


Nonconvex  constraints 

When  some  of  the  constraint  functions  g,  ’s  are  nonconvex  the  separable  piecewise  linear 
program  is  more  difficult  to  solve.  It  is  of  interest  to  note  that  problems  with  integer  0-1  res¬ 
trictions  can  be  formulated  as  problems  with  concave  (reverse  convex)  constraints.  For 
instance,  the  constraint  xke  [0,  1 }  can  be  written  as 

-xk2  +  xk  <0,  0Zxk<  1. 

For  problems  with  nonconvex  constraints  we  obtain  an  equivalent  formulation  with  linear 
constraints  and  zero-one  integer  variables  of  special  structure.  To  illustrate  the  idea  behind  this 
formulation  consider  one  of  the  functions  y^  (xk )  which  is  assumed  to  be  concave.  Let 

**  =2U  +  X  hk<*jk  (25) 

>=• 

where 

0  <  0)/  <  1,  j= 1,  .  .  .  ,nk 

<o;+1*  <zjk  <  (D,+i\  z/e{0,l},  y'=l,  .  .  .  ,nk- 1.  (26) 

Under  this  transformation  we  obtain  a  linearization  of  the  piecewise  linear  concave  function 
yik(xk)  by  setting 

y <*(**)  =  r ik<m)  +  E  «>7*(y,*(ai*  +  A)  -  y ate*  +  O'-i'A))-  (27) 

7=1 
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For  each  function  yrt  we  introduce  nk- 1  zero-one  integer  variables.  However,  because  of  (26) 
we  must  have 


z*  =  (z,* . z^_i*)  =  (1,  1, _ 1,0,0 . 0).  (28) 

This  property  of  zero-one  variables  makes  the  integer  problem  easier  to  solve,  since  zk  takes 
only  nk  possible  values,  instead  of  2"*  1  values  for  the  general  case  when  (28)  does  not  hold. 

Applying  the  above  arguments  for  all  constraint  functions  we  have  that,  in  case  of  con¬ 
cave  functions,  problem  (22)  is  eqivalent  to  the  following  problem: 

global  min  /(oo) 

n  Hk 

£  (  Yates*)  +  £  w/teatef*  +  jhk)  -  Ya tel*  +  (/-!)**))  ]  +rik  £  0,  t=l . m 

*=1  7=1 

0<to/<l,  k=l,  .  .  .  ,n,  y=l,  .  .  .  ,nk  (29) 

mJ+lk  <  zjk  <  oo>+i*,  z/e{0,l},  k= 1,  .  .  .  ,n  >=1 . n*-l 

"* 

0£  -  flj* ,  k=l,  .  .  .  ,n. 

)-t 

If  glttea)  >s  convex  we  may  use  the  same  transformation  as  in  (25),  (26)  and  (27).  How¬ 
ever,  in  the  presence  of  convexity  it  is  easy  to  see  (because  of  the  monotone  increasing 
slopes)  that  we  do  not  need  to  use  integer  variables.  Hence  it  is  clear  that  an  all-quadratic 
separable  problem  can  be  solved  by  solving  an  equivalent  concave  zero-one  program  with 
linear  constraints. 

Concluding  remarks 

This  paper  presents  different  methods  for  the  global  minimization  of  concave  functions 
subject  to  quadratic  separable  constraints.  The  first  method  is  a  branch  and  bound  algorithm 
based  on  rectangular  partitions  to  obtain  upper  and  lower  bounds  of  the  global  minimum.  Vari¬ 
ous  techniques  that  improve  branching  and  bounding  have  been  considered. 

We  also  discussed  bilinear  programming  techniques  to  approximate  the  feasible  domain 
using  convex  envelopes.  From  the  practical  point  of  view,  an  approximate  solution  is  desired. 
An  alternative  method  for  computing  an  e-approximate  solution  is  given  based  on  the  use  of 
piecewise  linear  approximations  of  the  constraint  functions.  For  convex  constraints  the  approxi¬ 
mate  problem  can  be  formulated  as  a  concave  minimization  problem  subject  to  linear  con¬ 
straints.  For  nonconvex  constraints  the  resulting  problem  has  linear  and  integer  0-1  constraints. 
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